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PREFACE 


In  testing  new  aircraft  for  flying  qualities,  determination 
of  lower  order  equivalent  systems  (LOES)  has  become  important. 
This  thesis  presents  a  technique  for  determining  lower  order 
equivalent  systems  in  the  time  domain.  This  data  reduction 
technique  is  also  useable  for  determining  basic  flying  qualities 
data,  such  as  short  period  frequency  and  damping  ratio. 

This  thesis  was  accomplished  under  the  auspices  of  the  joint 
Air  Force  Institute  of  Techno  1 o gy /US AF  Test  Pilot  School  Master's 
program.  The  data  reduction  technique  developed  by  this  thesis 
should  deprive  TPS  students  of  the  joy  of  spending  long  hours 
staring  at  strip  charts  by  substituting  as  a  more  efficient  data 
reduction  technique.  Additionally,  it  will  be  useful  in 
different  USAFTPS  projects  for  determination  of  Lower  order 
equivalent  systems. 

I  would  like  to  express  my  gratitude  to  Major  (Dr.)  James  T. 
Silverthorn  for  the  guidance,  assistance,  and  time  he  gave  me 
during  the  course  of  this  thesis. 

Richard  A .  Schroeder 
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\  ABSTRACT 

X  ^  fkusli 

X  This  r-e-p-^t-t  explains  the  data  reduction  technique  for  deter¬ 
mining  lower  order  equivalent  system  (LOEs)  parameters  using 

A 

flight  test  maneuver  time  history  d  a  t  a  This  technique  was 
developed  under  the  auspices  of  the  joij/t  AF1T/USAF  Test  Pilot 
School  Master's  Program. 
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-  This  technique  uses  MMLE3,  a  modified  NASA-developed  general 
program  for  maximum  likelihood  parameter  estimation.  MMLE3 
requires  a  state-space  model  relating  input  to  output  and  a  time 


history  of  the  input  and  the  output.  From  this  information, 
accurate  estimates  of  the  components  of  the  state-space  model  can 


be  made.  The  LOES  parameters  determined  by  MMLE3  would  be 
aircraft  short  period  frequency,  damping  ratio,  and  time  delay. 

Based  on  simulation  testing,  it  was  determined  that  this 
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data  reduction  technique  was  feasible  and  accurate.  ■  The  state- 
space  model  fur  the  testing  was  a  second  order  state-space  model 


incorporating  the  Pade  approximation  for  time  delay.  From 
simulated  data  using  a  pure  time  delay,  frequency  estimates  and 
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damping  ratio  estimates  were  within  2.25%  of  the  true  values, 
while  the  time  delay  estimate  was  within  18%  of  the  true  value. 
These  results  were  based  on  a  sampling  rate  of  8  samples  per 
second,  which  matches  the  USAF  TPS  in-flight  instrumentation 
system's  sampling  rate.  The  effect  of  different  sampling  rates 
and  signal  noise  on  estimate  accuracy  was  also  investigated.  The 
result,  as  expected,  was  that  a  higher  sampling  rate  increased 
the  accuracy  of  all  the  estimates.  For  any  given  sampling  rate, 
an  increase  in  the  noise  decreased  the  accuracy  of  all  of  the 
e  s  1 1 ma  t  e  s  . 
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The  algorithm  was  further  tested  by  using  flight  test  data 
gathered  in  a  T-38.  The  state-space  model  was  modified  to  a 
modified  second  order  model,  to  determine  basic  aircraft  short 
period  frequency  and  damping  ratio.  The  flight  test  results 
effectively  matched  the  published  values  of  frequency  and  short 
period  for  the  T-38. 

Based  on  the  results  of  this  testing,  this  technique  of 
determining  LOES  parameters  from  time  history  data  is  effective. 
It  should  be  incorporated  into  the  USAF  TPS  curriculum  for  data 
reduction. 


USE  OF  MMLE3  TO  DETERMINE 


LOWER  ORDER  EQUIVALENT  SYSTEMS 
IN  THE  TIME  DOMAIN 


1.1  BACKGROUND 

The  requirement  to  test  military  aircraft  flying  qualities 
exists.  The  criteria  defining  acceptable  flying  qualities  are 
contained  in  MIL-F-8785C,  Military  Specification:  Flying  Quali¬ 
ties  of  Piloted  Airplanes. 

KIL-F-8785C  essentially  defines  flying  qualities  in  terms  of 
two  decoupled  fourth  order  dynamic  responses.  One  fourth  order 
response  defines  aircraft  longitudinal  motion  in  terms  of  short 
period  frequency  and  damping  ratio  and  phugoid  frequency  and 
damping  ratio.  The  other  fourth  order  response  defines  aircraft 
lateral-directional  motion  in  terms  of  dutch  roll  frequency  and 
damping  ratio,  roll  mode  time  constant,  and  spiral  stability. 
MIL-F-8785C  is  based  on  fitting  aircraft  motion  to  these  two 
decoupled  fourth  order  responses. 

Frequently,  new  aircraft  cannot  easily  be  evaluated  against 
MIL-F-8785C  because  of  complex  aircraft  dynamics.  The  complex 
aircraft  dynamics  are  a  result  of  improvements  in  flight  control 
system  design,  which  allow  the  designer  to  optimize  aircraft 
response  to  control  input  for  any  given  flight  condition.  This 
optimization  can  introduce  additional  aircraft  dynamics,  produ¬ 
cing  an  aircraft/flight  control  system  which  no  longer  fits  the 
defined  flying  qualities  of  MIL-F-8785C.  As  an  example  of  how 
complex  the  aircraft  dynamics  can  become,  Figure  1  shows  a  sim- 


plified  block  diagram  for  Che  F-16  longitudinal  control  system  in 
the  landing  configuration,  as  well  as  the  overall  transfer  fun¬ 
ction  relating  pitch  rate  (q)  and  the  pilot's  longitudinal  con¬ 
trol  input  (6  )  (Ref  9). 
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Pitch  Rate  Response  Relation  to  Pilot  Input 
(F-16  Powered  Approach  Configuration) 

Figure  1 

The  closed  loop  transfer  function  denominator,  which 
characterizes  the  longitudinal  dynamic  response,  is  eighth  order, 
a  much  higher  order  of  dynamic  response  than  the  fourth  order 
response  expected  by  MLL-F-8785C.  The  problem  arising  from  this 
is  testing  the  flying  qualities  of  this  type  of  aircraft  against 
MIL-F-8785C . 


MIL-F-8785C  deals  with  this  problem  by  defining  the  flying 
qualities  of  this  type  of  aircraft  in  terms  of  lower  order 
equivalent  system  (LOES).  For  longitudinal  motion,  the  LOES 


would  be  Che  apparent  aircraft  short  period  handling  qualities. 
This  LOES  would  be  as  shown  in  figure  2. 


Pitch  Rate  Response  Relation  to  Pilot  Input 
(Lower  Order  Equivalent  System) 

Figure  2 

The  terms  in  this  closed  loop  transfer  function  contain  an 
aircraft  response  equivalent  to  the  eight  order  response  shown  in 
Figure  1.  The  parameters:  equivalent  frequency,  w ^  ,  equivalent 
damping  ratio,  ,  and  the  equivalent  time  delay,  , 
effectively  duplicate  the  higher  order  response,  and  define  the 
LOES.  MIL-F-8785C  uses  the  LOES  parameters  to  define  acceptable 
flying  qualities. 

The  most  common  technique  for  determining  LOES  parameters 
uses  frequency  domain  data.  Determining  LOES  parameters  in  the 
frequency  domain  involves  gathering  the  time  history  of  both  the 
input  and  the  output,  converting  them  to  the  frequency  domain  via 
Fast  Fourier  Transform  algorithm,  calculating  the  experimental 
Bode  plot,  and  then  determining  the  LOES  parameters  that  minimize 
a  hted  least  squares  curve  fit  to  this  frequency  response 
(Ref  .. 

The  method  of  gathering  time  domain  data  to  convert  into 
frequency  domain  data  is  computationally  intensive.  By  use  of 
maximum  likelihood  parameter  estimation,  it  should  be  possible  to 
determine  LOES  parameters  directly,  in  the  time  domain. 


The  time  interval,  T,  used  for  the  majority  of  the  testing 
was  0.125  seconds.  This  interval  was  used  because  the  in-flight 
instrumentation  system  samples  at  this  interval. 

There  were  two  purposes  of  this  phase  of  testing  MMLE3. 
First,  this  testing  would  verify  that  MM LET  worked  for  a  problem 
other  than  the  sample  problem  provided  with  the  program.  Second, 
this  testing  could  be  used  to  analyze  what  flight  test  techniques 
(FTTs)  should  or  could  be  used  in  flight  to  determine  a  LOES. 

For  longitudinal  motion,  a  LOES  is  defined  by  the  aircraft 
short  period  response  (ref  1,2).  Aircraft  pitch  rate  response  is 
most  commonly  used  as  the  aircraft  response  which  defines  the 
LOES  (ref  2).  To  determine  the  LOES,  the  aircraft  short  period 
dynamics  have  to  be  excited.  The  response  has  to  be  large  enough 
to  be  detected,  yet  remain  within  the  linear  range  of  aircraft 
motion  (ref  6,8).  There  are  FTTs  currently  used  which  accomplish 
this  (ref  9). 

One  FTT  for  exciting  an  aircraft  short  period  is  the 
elevator  doublet.  In  this  maneuver,  the  pilot  makes  a  cyclic 
control  input,  first  nose  up,  and  then  nose  down,  of  equal 
magnitude  in  both  directions,  and  then  returns  the  control  to  the 
neutral  position.  The  control  input  frequency  matches  the 
aircraft's  short  period  frequency.  The  damping  ratio  can  be 
estimated  by  counting  the  number  of  visible  overshoots  during  the 
aircraft's  free  response.  An  estimate  of  the  damping  ratio 
equals  seven  minus  the  number  of  overshoots  divided  by  ten.  An 
elevator  singlet  can  also  be  used  with  similar  results. 

The  other  common  FTT  used  to  evaluate  the  aircraft  short 


period  is  the  n/a  sweep. 


In  this  maneuver,  the  pilot  attempts  to 


used  for  Che  simulation  was  F-89  aircraft  data  obtained  from 


Aircraft  Dymamics  and  Automatic  Control  (ref  7). 
The  simulation  model  used  was: 
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The  eigenvalues  of  the  A- matrix  are: 
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\ L  2=-2 . 1003+ j3 .8700 
A  ^  , =-0 . 0080+ jO  .  0605 

producing  these  frequencies  and  damping  ratios: 

=4.403  rad/sec,  r  =0.477 
nsp  s  p 

■jj  =0.060  rad/sec,  r  =0.133 

P  P 

The  data  was  generated  using  the  same  propagation  scheme  as 

M  M  L 1 3  uses  to  generate  its  estimates.  The  control  input  which 

MMLK3  uses  to  determine  the  calculated  states  x(t  )  uses  the 

~  i  +  1 

average  control  input  over  t  and  t  .  This  propagation  is  used 

i  i+l 

to  compensate  for  control  motion  between  samplings  of  the  control 
position.  To  ensure  that  good  parameter  estimates  result  from 
the  simulated  data,  the  same  propagation  scheme  was  used  to 
generate  the  data. 

The  formula  used  to  generate  the  data  was: 


Chapter  3 


3.1  MMLE3  Installation 

The  NASA  provided  MMLE3  program  was  incompatible  with  the 
USAF  Test  Pilot  School  PDP-11/34  computer.  It  required  more 
memory  capability  then  was  available  on  the  computer.  In  order 
to  be  able  to  use  the  basic  algorithm,  the  NASA  provided  program 
had  to  be  modified.  The  modifications  involved  were  reduction  in 
the  matrix  sizes  used  in  MMLE3,  removal  of  an  option  to  generate 
estimates  in  the  presence  of  state  noise,  removal  of  the 
program's  plotting  capability,  and  the  development  of  a  software 
overlay  structure.  The  many  modifications  made  to  the  program 
made  it  possible  that  the  basic  algorithm  would  somehow  be 
affected  and  rendered  useless.  To  verify  that  the  program  was 
functioning  normally  after  it  had  been  adapted,  it  was  necessary 
to  test  it  against  a  known  case. 

When  the  program  was  obtained  from  NASA,  a  sample  data  time 
history,  the  associated  math-model,  and  the  resulting  estimates 
were  also  obtained.  For  the  initial  testing  of  MMLE3,  this  was 
used  to  verify  that  the  program  was  functioning  normally.  The 
sample  data  used  was  test  case  4  in  reference  4.  This 
installation  of  MMLE3  yielded  the  proper  estimates  from  this 
data  . 

3.2  Testing  MMLE3 

To  increase  confidence  that  the  program  was  working 
properly,  and  to  determine  flight  test  maneuvers  for  later  use, 
simulated  data  was  generated  for  processing  by  MMLE3.  The  data 
generated  was  based  on  aircraft  longitudinal  motion.  Information 


With  an  adequate  state-space  model  and  a  good  initial 
estimate  at  the  answer,  then  MMLE3  only  needs  a  time  history 
relating  control  input  and  system  output  lo  yield  estimates  of 
state  parameters. 
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the 

diagonal  state  matrix 

consists 

of  the  system 

e igen va 1 ues ,X i  ,  and  A2  .  Once  again,  though,  the  states  x^  and 
are  dummy  states  which  do  not  necessarily  have  physical 
significance . 

In  the  math-models  shown  above,  various  matrix  components 
are  independent  of  the  system  response.  These  matrix  components 
are  not  allowed  to  vary  while  MMLE3  estimates  the  system 
parameters  (which  consist  of  the  other  matrix  elements).  MMLE3 
input  conventions  allow  the  user  to  define  which  matrix  elements 
are  allowed  to  vary  and  any  multiplicative  relationships  between 
matrix  elements.  (See  Appendix  B) 

For  use  in  determining  LOES  parameters,  the  standard 
controllable  state-space  model  will  be  used  as  a  basis.  This 
state-space  model  will  be  used  because  it  is  the  least 
complicated,  with  response  to  interrelationships  of  different 
matrix  elements. 

2  .  A  Summary 

MMLE3  is  the  basis  for  determining  LOES  parameters  from 
aircraft  control  input  and  pitch  rate  time  histories.  MMLE3  can 
determine  various  system  parameters,  based  on  what  state-space 
model  is  used  to  define  the  system.  In  order  to  use  MMLE3,  the 
state-space  model  needs  to  be  defined,  and  an  initial  estimate  of 
the  answer  needs  to  be  available.  In  order  for  MMLE3  to  converge 
to  a  solution,  this  initial  estimate  needs  to  be  reasonable,  or 


MMLE3  will  not  converge. 
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Several  state-space  models  which  relate  the  input  u  to  the 
output  z  can  be  constructed.  Each  model  is  a  valid  math-model 
which  yields  slightly  different  information  about  the  system. 

The  standard  controllable  state-space  model  is: 
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The  states  x^  and  x^  are  dummy  variables  which  serve  only  to 
generate  the  output  z.  These  states  need  not  ha  /e  any  physical 
significance,  but  only  need  to  be  properly  related  to  z(t  ). 

The  standard  observable  state-space  model  is: 
x~(t)  0  1  x  (t)  x 

{  t  }  =  [  2  ]{  3  }  +  t  ]  UU) 

x,(t)  -0)  -2^0)  x ,  ( t )  (l-2£u  T) 

4  n  n  4  n 

(17) 

x3(t  ) 

z(t  )  =  [  1  0  ]{  J  1  } 

w 

In  this  model,  the  state  is  identical  to  the  output  z.  The 

state  x^  is  a  dummy  state  used  to  complete  the  math  model.  The 
control  input  is  slightly  more  complicated  to  generate  a  math 
model  which  properly  relates  input  to  output. 

The  canonical  state-space  model  is: 


12 


(14 


Covariance(0-^£^  (  (V^z^(t^)  )  R  (7,zr(t.))] 

The  covariance  matrix  is  directly  analagous  to  the  variance  in  a 
scaler  gaussian  distribution.  The  smaller  the  values  of  the 
elements  of  this  matrix,  the  higher  the  confidence  of  the 
estimate  of  the  corresponding  unknown  value  in  the  vector  £ 

As  more  samples  are  taken,  (14)  approaches  an  equality  (ref  3, 
5).  Although  relatively  few  samples  may  be  taken,  the  covariance 
matrix  (sometimes  called  the  Fisher  information  matrix)  can  still 
be  taken  as  an  indication  of  confidence  in  the  estimate.  If  the 
value  s  relatively  large,  then  the  corresponding  estimate  is  not 
as  good  an  estimate  as  if  the  corresponding  value  in  the 
covariance  matrix  were  relatively  small.  The  covariance  matrix 
is  computed  by  MMLE3  to  give  a  measure  of  confidence  in  each 
estimate. 

2.3  Suitable  Math  Models  for  MMLE3 

In  order  for  MMLE3  to  determine  the  best  fit  to  a  math 
model,  it  requires  a  time  history  of  the  input  and  the  output  and 
a  math  model  relating  input  and  output.  The  math  model  needs 
only  to  be  a  valid  state-space  model  which  relates  the  input  to 
the  output.  This  allows  use  of  a  state-space  model  which  yields 
the  information  which  the  user  wants  from  the  model. 

In  control  theory,  there  are  many  different  state-space 
models  which  can  describe  the  same  system.  As  a  brief  example,  a 
simple  second  order  system  will  be  examined  (ref  5). 

Consider  the  classical  second  order  dynamic  response 


described  by  the  transfer  function: 


£i+1-  V(^} 


(ii 


V  J(ii)  =iii  [ (2c(t.)-z(t.))T  r"1  (V?i(ti))] 

2  N 


(12. 


V(-i}  "i=l  [(Vczc(t.))T  R-1  (Vczc(ti))] 

+,L  [(ir(t  )-z(t  ))T  R_1(v!z,(t))]  (13 

Computation  of  the  second  term  of  (13)  is  significantly  more 

complex  than  either  the  first  term  of  (13)  of  all  of  (12)*  If  £ 

is  close  to  r  ,  this  second  term  approaches  the  value  zero, 
—true 

the  modified  N  e  w  t  o  n- Ra  ph  s  o n  algorithm  assumes  that  the  second 
term  is  zero,  and  ignores  it.  This  places  a  restriction  on  the 
algorithm  that  the  initial  guess  be  close  to  the  true  value. 
This  means  that  some  estimate  of  the  answer  must  be  available, 
and  it  must  be  reasonably  close  to  the  true  answer.  To  allow  a 
better  probability  of  convergence  when  the  initial  guess  may  not 
be  good,  an  option  exists  in  the  program  to  perform  the  first 
several  iterations  using  a  gradient  algorithm  rather  than  this 
modified  Newton-Raphson  algorithm. 

The  answer  yielded  by  this  maximum  likelihood  estimator  can 
be  shown  to  be  (Ref  4,  5,  6): 

1 )  Consis  tent 

2)  Asymptotically  unbiased 

3)  Asymptotically  efficient 

4)  Asymptotically  gaussian 

Because  the  estimator  has  these  characteristics,  it  can  be  shown 
that  the  minimum  covariance  in  the  estimate  is  given  by:  (Ref  3, 


measurements  taken.  Civen  the  value  Z,  the  intent  is  to 


determine  £  .  Mathematically,  we  are  looking  for  the  probability 
density  function  p(£|Z). 

By  using  Baye's  rule,  this  value  can  be  determined  by  using 
other  known  values.  Baye's  rule  says: 

P<Zli>=  i4ffTl  (?) 


p (£| Z) =p (Z | O 


EjC) 

p(z) 


(8) 


Z  is  a  set  of  measured  values.  p  ( Z )  is,  then,  constant.  p(^)  is 

also  a  constant  because  no  restrictions  are  placed  on  its 

possible  values.  The  probability  density  function  p(Z|  [)  can  be 

written  based  on  the  statistics  of  the  noise  n(t  ).  (Ref  3,  5) 

i 


P  (Z  |  C.)  -  [  (2tt)  m  |  R  [  ] 


-N/2 


exp  {  (z^.(t  . 


))TR"I(zc(ti)-z(ti))}  (9) 


Maximizing  this  probability  is  the  same  as  maximizing  the 
probability  p(tjz)  because  the  two  are  related  by  a  constant. 

A  simpler,  but  identical,  problem  can  be  yielded  by  taking 
the  natural  logarithm  of  (‘f  ) ,  disregarding  the  constant  terms, 
and  minimizing  the  negative.  The  cost  functional  then  becomes: 

N  T  -1 

J(C)=%  ^  [ (zr(t.)-z(t.))i  R  (zr(t.))l  (10) 

i  =  l  4  1  1  ^  1 


Minimizing  this  functional  yelds  the  vector  ‘'which  best  fits 
the  math  model  representing  the  aircraft  dynamics. 

MMLE3  maximizes  this  functional  by  using  a  modified  Newton- 
Raphson  algorithm.  The  algorithm  is: 


where  R  is  the  measurement  noise  covariance  matrix. 

The  math  model  is  a  theoretical  duplicate  of  the  aircraft 
dynamics .  It  is  : 


(t)  =  A  ( £ )  x(t)  +  B(£)u(t) 


z£t.)  =  C(£)x(t.)  +  D(£)  u(t.) 


(5) 

(6) 


The  vector  x^.  ( t )  is  the  calculated  value  of  the  state  vector, 
based  on  the  known  control  inputs  and  the  estimated  values  for 
£  .  The  vector  z  ,( t )  Is  the  calulated  value  of  the  measure¬ 
ment  vector  based  on  x  (t).  The  vector^  contains  the  unknown 
parameters  which  define  the  math  model  through  the  matrices  A,  B, 
C ,  and  D . 

The  actual  aircraft  dynamics  are  assumed  to  be 
deterministic.  By  measuring  the  error  between  the  actual 
aircraft  dynamics  and  the  output  of  the  math  model,  and  then 
adjusting  the  math  model  based  on  the  error,  MMLE3  determines  the 
maximum  likelihood  values  for  the  components  of  the  matrices 
which  define  the  math  model.  The  noise  which  corrupts  the 
measurements  of  the  aircraft  dynamics  is  assumed  to  be  white 
noise  of  known  statistics.  Because  of  this,  determining  the 
vector  £  becomes  a  problem  in  stochastic  estimation. 

The  known  value  is  the  vector  measurement  z(t  ).  Here,  it 

-  i 

will  be  considered  that  the  vector  Z  incorporates  all 


measurements  taken  up  to  time  t  . 


N  Is  the  total  number  of 


calculating  the  total  difference  between  the  system  measurement 
z(t)  and  the  calculated  output  z  (t)  for  the  entire  time  history, 
and  using  that  error  to  determine  how  to  change  the  vector  £ 

The  total  squared  error  at  the  end  of  each  iteration  in  MMLE3 
is  compared  with  the  previous  iteration's  total  squared 
error.  When  these  two  values  are  within  0.1%  of  each  other, 
MMLE3  assumes  that  it  has  converged  to  a  solution. 

2.2  Theory  of  MMLE3 

MMLE3  is  based  on  the  assumption  that  there  is  some 
functional  relationship  between  the  control  input  ij  (  t )  and  the 
output  z(t).  This  relationship  is  expressed  by: 


x(t)  =  A(  F  )x(t)  +B(  F  )u( t ) 

—  -^true  ~  ■“true  — 

z(t.  )  -  C(  F  )  x  ( t  )  +  D(£  )u(t  )  +  n(t  ) 

—  i  ^true  —  i  "nirue  —  i  ~  i 


The  vector  x(t)  consists  of  "n"  state  variables,  the  input  vector 

u_  (  t )  has  "m"  components,  and  the  output  vector  (  t  )  has  "p" 

~  i 

components.  For  the  version  of  MMLE3  on  the  U  S  A  F  TPS  computer, 
the  maximum  value  of  n,  m,  or  p  is  5.  The  noise  vector  ii(t) 
corrupts  the  measurement  vector  z(t^.  The  statistics  of  n(t)  are 
assumed  to  be: 


E{  n(t^) }  =0 

T  R  ti=ti 

E{  n(t  )  n(t.)}  ={  3 

3  0  t.*t. 

i  J 


Chapter  2 


2.1  Introduction  to  MMLE3 

MMLE3,  the  program  used  to  determine  the  LOES  parameters,  is 
a  general  program  for  maximum  likelihood  parameter  estimation. 
(Ref  3,  4)  MMLE3  has  been  implemented  on  the  USAF  TPS  PDP-11/34 
computer  to  solve  the  problem  shown  in  Figure  3. 


Block  Diagram  of  MMLE3  Math  Model 
Figure  3 

The  math  model  used  in  MMLE3  is  a  discrete  time  representation  of 
a  continuous  system  reacting  to  small  perturbations  from  a  steady 
state  condition.  The  model  involves  a  vector  of  unknown 
parameters,  £  ,  to  be  estimated  by  the  MMLE3  algorithm.  The 
measurements  of  both  the  math  model  and  the  real  system  are  at 
discrete  times.  The  math  model  relates  the  control  input  u(t)  to 
the  calculated  output  z(t).  MMLE3  adjusts  the  math  model  by 


data  was  used  to  determine  suitable  flight  test  techniques  for 
exciting  aircraft  short  period  response  to  generate  good  time 
histories  for  MMLE3.  Through  simulated  data,  basic  flying 
qualities  data  reduction  on  MMLE3  is  evaluated.  With  a  pure  time 
delay  introduced  into  the  .'mulation,  MMLE3  is  used  to  identify 
system  parameters  with  a  math  model  incorporating  a  time  delay. 
Finally,  a  lag  filter  is  introduced  into  the  simulation  model  to 
model  a  simple  flight  control  system.  MMLE3  is  used  to  determine 
LOES  parameters  based  on  this  data. 

Flight  test  data  is  also  processed  by  MMLE3  to  show  the 
capability  of  MMLE3  to  successfuly  generate  flying  qualities  data 
from  the  USAF  TPS  Data  Acquisition  System.  The  results  of  this 
limited  flight  test  are  presented  in  Chapter  4. 

Conclusions  and  recommendations  are  made  in  the  final 
chapter  of  this  thesis. 


This  thesis  will  present  an  approach  for  determining  LOES 
parameters  based  on  data  gathered  in  the  time  domain.  This 
thesis  was  sponsored  by  the  USAF  Test  Pilot  School  (USAF  TPS), 
and  had  specific  objectives.  The  objectives  were: 

1.  Provide  a  useable  maximum  likelihood  estimation 
algorithm  for  use  on  the  USAF  TPS  computer  system. 

2.  Determine  the  feasibility  of  using  maximum  likelihood 
estimation  to  determine  LOES  parameters  in  the  time  domain. 

3.  Determine  whether  or  not  the  current  USAF  TPS  in-flight 
instrumentation  system  is  adequate  for  this  application. 

4.  Assuming  that  this  technique  is  feasible  and  that  the 
instrumentation  is  adequate,  provide  the  USAF  TPS  a  flying 
qualities  data  reduction  system  using  the  maximum  likelihood 
estimation  algorithm. 

1 .  3  Overview 

This  thesis  follows  the  organization  explained  in  the 
following  paragraphs. 

Chapter  2  discusses  the  theory  of  the  maximum  likelihood 
estimation  program  (MMLE3).  MMLE3  is  a  general  program  for 
maximum  likelihood  parameter  estimation  developed  by  the  National 
Aeronautics  and  Space  Administration  to  extract  stability  deriva¬ 
tives  from  flight  test  data.  Chapter  two  explains  in  detail  the 
algorithm  used  in  the  program,  along  with  its  limitations  on  the 
program.  Chapter  2  also  discusses  general  requirements  for  the 
state-space  model  and  the  input  data. 

Verification  testing  of  the  installation  of  the  MMLE3 
program  on  the  computer  is  discussed  in  Chapter  3.  Simulated 


put  in  a  sinusoidal  input  to  the  elevator.  The  ideal  input  will 
have  the  pilot  moving  the  control  stick  forward  as  the  aircraft 
nose  is  rising,  and  moving  the  control  stick  backwards  as  the 
aircraft  nose  is  falling.  If  the  maneuver  is  done  well,  the 
pilot's  input  frequency  equals  the  aircraft's  damped  short  period 
frequency.  By  doing  both  maneuvers  at  one  trim  point,  a  pilot 
can  determine  an  approximation  to  both  the  short  period  frequency 
and  damping  ratio. 

Since  the  above  FTTs  are  already  used  to  determine 
approximations  to  an  aircraft's  short  period,  the  same  FTTs 
should  be  good  for  generating  data  for  MMLE3  to  determine  short 
period  frequency,  damping  ratio,  and  time  delay.  Both  types  of 
control  inputs  were  used  in  the  simulation  program  to  generate 
data. 

Initially,  MMLE3  was  used  to  detemine  the  parameters  of  the 
A-matrix  most  closely  related  to  the  short  period  response. 
These  parameters  are  pitch  stiffness,  C^,  A93,2),  pitch  damping, 
Cmq  ’  A<3»3)«  and  elevator  power,  Cm<Se  ,  B(l,3).  These  are  the 
elements  in  row  three  of  both  the  A-matrix  and  the  B-matrix.  All 
of  the  other  parameters  in  the  matrices  were  assumed  known  and 
therefore  held  constant  by  MMLE3.  Ten  seconds  of  simulated  data 
from  both  FTTs  were  processed  by  MMLE3  to  determine  these 
parameters.  Aircraft  pitch  rate  output  q  was  fitted  to  control 
input  to  determine  thes  parameters.  Results  from  MMLE3  are  shown 
in  Figures  4,  5,  and  6. 


Variation  of  Accuracy  in  Cm6e  Estimate 
with  Different  Sinusoidal  Input  Frequencies 

Figure  6 

With  an  elevator  doublet  or  singlet  as  the  input,  MMLE3 
converges  to  the  solution  which  matched  the  values  used  to 
generate  the  simulated  data.  With  sinusoidal  input  frequencies 
between  1  and  10  radians  per  second,  MMLE3  also  converges  to  the 
same  values  as  the  ones  used  to  generate  the  simulated  data.  If 
the  sinusoidal  input  frequencies  are  close  to  the  natural 
frequency,  there  is  virtually  no  difference  between  the  Cramer- 
Rao  bounds  of  the  estimates  yielded  by  either  FTT ,  as  shown  by 


r.w/j.v  wvw*.' 


I  npu  t 
Technique 

C  /  C 
ma  ma 

c  /c 

mq 

mq 

C  .  /C 
m  oe 

m  5e 

Step 

1.001 

(0.005) 

1.000 

(0.018) 

1.000 

(0.009) 

Double  t 

1.000 

(0.004) 

1.000 

(0.014) 

1.000 

(0.010) 

n  lc*  sweep 

4.0  rad/sec 

1.001 

(0.003) 

0.999 

(0.013) 

1.000 

(0.009) 

(*.***)  denotes  the  estimate's  Cramer-Rao  bound 

Comparison  of  Estimate  Accuracies 
Using  Different  Flight  Test  Techniques 

Table  1 

MMLE3  yields  these  results  as  long  as  the  initial  guess  is 

close  to  the  final  solution.  With  an  initial  guess  of  the 

correct  answer,  the  solution  converged  in  approximately  four 

iterations.  With  the  initial  guess  up  to  50%  off,  it  takes  no 

more  than  10  iterations  to  converge.  The  final  estimate,  though, 

was  always  the  same.  Because  of  the  excellent  results  of  this 

test  of  MMLE3,  it  was  apparent  that  it  was  functioning  properly. 

It  was  also  apparent  that  classical  FTTs  would  be  suitable  for 

exciting  short  period  dynamics  for  MMLE3  parameter  estimation. 

3.3  MMLE3  Parameter  Estimation  for  a  Second  Order  Response 

Further  testing  of  MMLE3  was  conducted  using  the  same 

simulated  data.  Short  period  frequency  and  damping  ratio  were 

determined  by  fitting  the  measured  pitch  rate  response  and  I 

< 

control  input  to  a  second  order  response,  as  shown  in  Fig  7.  . 
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Pitch  Rate  Response  Relation  to  Pilot  Input 

Figure  7 

The  transfer  function  is  easily  convertible  into  the 

standard  controllable  state-space  model.  The  model  is: 

x .  (t)  0  1  0 

{  1  }  =  [  ]  +  {  )  6  (t) 

x„(t)  -to 2  -2^(0  K  P 

2  n  n  q 

(21 


x  (t  ) 

'  1  ‘^0e  1  I  {  ,  > 

x2<ti) 

There  are  three  unknowns  associated  with  this  model:  to  ,  L  , 

e  e 

and  K  .  The  value  1/T^  is  assumed  to  be  identical  to  the  value 

Oe 

1  /  Tq^  »  1*372,  as  given  for  the  F-89  aircraft  (ref  7). 

As  discussed  previously,  an  elevator  doublet,  a  sinusoidal 
elevator  input  or  a  simple  step  input  are  all  good  for  exciting 
short  period  dynamics  for  parameter  estimation.  No  significant 
differences  were  noted  between  estimates  yielded  by  the  three 
control  inputs.  Figure  8  compares  the  simulated  time  history  of 
pitch  rate  response  to  a  unit  step  input  to  the  time  history  of  a 
second  order  transfer  function  with  the  parameters  estimated  by 
MMLE3.  As  can  be  seen,  there  are  no  significant  differences 


between  the  two  time  histories. 
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Time  History  Comparison 
Figure  8 

For  a  system  with  no  time  delay,  the  MMLE3  algorithm  would 
be  extremely  useful  for  determining  short  period  frequency  and 
damping  ratio.  This  data  reduction  technique  would  use  a  forced 
response,  and  fit  the  response  to  a  second  order  state-space 
model,  using  all  measured  data  points.  This  would  be  a 
significant  Improvement  to  the  1 o g - d e c r e me n t  method  of  data 
reduction  currently  used  at  the  USAF  TPS  (ref  9). 

3.4  Incorporating  A  Time  Delay 

Actual  aircraft  do  not  respond  instantaneously  to  a  pilot's 
control  input.  After  a  control  input,  there  may  be  some  time 
delay,  associated  with  system  lags,  before  the  aircraft  reacts. 
MMLE3  should  be  able  to  estimate  that  delay,  if  given  an  adequate 


state-space  model.  To  determine  if  MMLE3  could  identify  a  time 
delay,  the  simulation  model  was  modified  to  incorporate  a  pure 
time  delay  between  control  input  and  aircraft  reaction.  A  simple 
block  diagram  of  a  system  incorporating  a  time  delay  is  shown  in 
Fig  9. 


Pitch  Rate  Response  Relation  to  Pilot  Input 
(Time  Delay  Incorporated) 

Figure  9 

“■  T  S 

The  time  delay  in  the  system  is  introduced  by  the  term  e 
The  time  delay  is  t.  In  order  to  transform  this  transfer  func¬ 
tion  into  a  state-space  model  of  the  same  form  as  (19),  the  Pade 
approximation  to  a  time  delay  is  used.  The  Pad  a  approximation 
i  s  : 


-T  S 


-  (ts-2) 


(22) 


(ts+2) 


In  the  frequency  domain,  this  approximation  is  fairly  good 
for  low  frequency  inputs,  as  shown  by  the  Bode  phase  plot  in  Fig 
10.  The  Bode  magnitude  plots  match  exactly.  Based  on  this,  the 
frequency  sweeps  used  to  excite  the  short  period  dynamics  should 
be  low  f-equency  inputs,  to  preserve  the  approximation  accuracy. 
Since  both  the  elevator  doublet  and  the  n  ,(x  sweep  are  low 
frequency  inputs,  the  Pade^  approximation  should  be  adequate  for 
the  time  delay  model  for  these  inputs. 


The  net  effect  of  this  is  to  shift  time  response  of  a  system  by 
some  amount  of  time  slightly  less  than  T  .  A  slight  initial 
response  opposite  the  overall  response  is  induced  because  of  the 
exponential  form,  but  this  effect  should  be  small. 

The  time  delay  exists  between  the  pilot's  input  and  the 
aircraft  reaction.  In  block  diagram  format,  it  is: 


Pitch  Rate  Response  Relation  to  Pilot  Input 
(Pade/  Time  Delay  Approximation  Incorporated) 

Figure  11 

The  input  to  the  aircraft  is  x  ^  ,  a  dummy  variable  which 

represents  the  pilot  input  and  the  time  delay  before  the 


aircraft  reacts.  The  math  model  for  x  is: 


X, (t)  =  - ( 2 /t ) x  (t)  +  (2/i)6  (t) 


x  ( c )  =  2x  ( t ) +6  ( t ) 
3  4  p 


Incorporating  the  time  delay  into  the  standard  controllable  model 
in  (21)  yields  the  new  model,  which  has  a  time  delay. 


x  ^  (  t ) 


x  1  ( t ) 


{  X  (t)  }  =  [ -CO 2  -2C  u  2K  ]  {  x„(t)}  +  [  -  K  ]  6  (t) 

z  e  e  e  q  i  qp 

x4(t)  0  0  -  2 / T  x,(t)  2  /  T 


■  2 / T  x4(t)  2/t 


q(ti)  =  [1/T0e  1  °Hx1(t.)  x2(t.)  x^t.)}1 

The  model  above  uses  the  three  parameters  which  define  a 
LOES,  time  delay,  equivalent  frequency,  and  equivalent  damping 
ratio.  By  adjusting  these  parameters  so  that  the  model  output 
best  matches  a  time  history,  a  LOES  is  defined. 

To  test  the  model,  simulated  data  incorporating  a  125 
millisecond  time  delay  was  generated.  The  simulated  data  was 
generated  using  both  low  frequency  sinusoidal  control  inputs  and 
step  inputs.  Table  2  summarizes  the  results: 


U)  /Tad. 

nsp  (  ) 

sec 

^  s  p 

X  ( sec ) 

True 

Value 

4.403 

0-477 

0-125 

Estimated 

Value 

4.501  (0.036) 

.470  (0.016) 

.147  (0.003) 

3.5  Effect  of  Data  Sampling  Rate  on  Estimate 


Since  all  data  being  analyzed  was  computer  generated,  no 
physical  limits  existed  for  the  data  sampling  rate.  To  analyze 
the  effect  of  data  sampling  rate  on  estimate  accuracy,  data  was 
generated  at  different  sampling  rates,  and  then  processed  by 
MMLE3.  The  only  difference  in  the  data  generated  was  the 
sampling  rate  (inverse  of  the  time  interval  T)  and  the  actual 
time  delay.  The  time  delay  used  at  the  8  samples  per  second 
(sps)  and  40  sps  points  was  125  milliseconds.  At  the  25  sps  and 
50  sps  points,  the  time  delay  was  1  2©  milliseconds.  At  the  10 
sps  point,  the  time  delay  was  100  milliseconds.  The  data  is 
presented  in  Figures  12,  13,  and  14. 
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As  can  be  seen  from  the  preceding  graphs,  tine  accuracy  of 
the  estimate  increases  as  the  sampling  rate  increases.  With  a 
higher  sample  rate,  a  more  accurate  estimate  of  all  parameters  is 
obtained.  Of  particular  interest,  the  estimate  of  the  time 
delay,  T  ,  increases  in  accuracy  with  a  higher  sample  rate.  From 
these  results,  it  appears  that  a  data  rate  of  20  to  25  samples 
per  second  will  yield  good  estimates  through  MMLE3.  It  also 
appears  that  a  data  rate  of  8  samples  per  second  will  yield 
marginally  acceptable  estimates. 

3.6  Effect  of  Measurement  Noise  on  Estimate  Accuracy 

Every  instrumentation  system  will  introduce  some  noise  and 
inaccuracies.  These  inaccuracies  and  the  noise  in  the 
measurements  complicate  the  estimation  problem  by  "hiding"  the 
signal.  The  overall  effect  of  the  noise,  at  best,  is  to  increase 
the  Cramer-Rao  bounds  of  the  estimate.  At  worst,  it  will 
completely  "hide"  the  signal  so  that  no  parameters  can  be 
identified.  A  suitable  measurement  of  the  amount  of  noise 
present  in  the  data  was  necessary.  Since  simulated  data  was 
used,  a  form  of  signal-to-noise  ratio  (SNR)  was  used.  For  the 
graphs  which  follow,  the  SNR  is  the  ratio  of  the  magnitude  of  the 
largest  observed  response  to  the  root  mean  square  (RMS)  of  the 
noise  covariance. 

To  generate  noise  corrupted  data,  a  subroutine  which 
generated  zero-mean,  white  noise  was  incorporated  into  the 
simulation.  The  RMS  level  was  adjusted  to  match  the  +  1 
d e g r e e / s e c o nd  accuracy  of  the  USAFTPS  instrumentation  systems. 
The  simulated  noise-corrupted  data  was  generated  u^.ing  the  basic 
simulation  program.  After  noise-free  data  was  generated,  the 


white-noise  subroutine  was  called  to  introduce  noise  into  the 
pitch  rate  respone.  The  SNR  was  adjusted  by  varying  the  size  of 
the  control  input  while  holding  the  noise  RMS  constant.  Analysis 
of  the  effect  of  noise  on  estimate  accuracy  was  done  at  a  data 
rate  of  8  sps  and  25  sps.  Figures  15,  16,  and  17  display  the 
results  of  the  effects  of  different  s  i  g n a  1  - t o - n o i s e  ratios  on 


estimate  accuracy. 


lues  as  well.  The  MMLE3  results  are  slightly  higher  than  the 
cepted  values.  The  difference  in  aircraft  motion,  though, 
tween  a  0.30  damping  ratio  and  a  0.36  damping  ratio  would  be 
discernable  to  a  pilot.  The  accepted  values  for  the  damping 
tio,  and  the  MMLE3  results,  are  both  essentially  constant, 
rresponding  to  the  theoretical  prediction  for  short  period 
mping  ratio  at  a  constant  altitude.  Overall,  the  MMLE3  results 
r  damping  ratio  are  accurate. 

The  MMLE3  results  for  T-38  short  period  motion,  both 
equency  and  damping  ratio,  match  the  accepted  values.  This 
ows  that  the  USAF  TPS  in-flight  instrumentation  system  is 
equate  for  use  with  MMLE3.  This  also  demonstrates  a  basic 
ying  qualities  data  reduction  capability  using  MMLE3. 
ocessing  the  test  flight's  data  with  MMLE3  showed  two  main 
strictions  on  the  type  of  useable  data. 

The  primary  restriction  on  the  data  is  that  the  time  history 
the  maneuver  included  a  stable  point  immediately  prior  to  the 
neuver.  The  MMLE3  results  for  elevator  doublet  inputs  at  240 
AS/0.48  Mach  and  400  KIAS/0.78  Mach  are  absent  from  Table  3. 
lis  is  because  the  data  time  history  for  those  FTTs  were 
luseable  by  MMLE3.  At  these  test  points,  the  elevator  doublet 
is  flown  immediately  after  the  n/a  sweep,  without  pausing  to 
;trim  the  aircraft  for  stable  flight.  The  overall  time  history 
d  not  have  a  good  stable  point  prior  to  the  FTT  time  history, 
thout  a  stable  point  against  which  to  measure  perturbations, 
le  MMLE3  results  failed  to  converge.  As  shown  by  Table  4,  the 
:tual  time  history  length  of  the  stable  point  is  unimportant. 


.3  Test  Results  and  Analysis 

Table  3  summarizes  the  MMLE3  results  and  shows  the  accepted 
alues  for  T-38  short  period  frequency  and  damping  ratio  for  the 
est  points. 

The  MMLE3  results  for  short  period  frequency  correspond 
lose  ly  to  the  accepted  values.  The  low  speed  point,  200 
IAS/0.48  Mach,  and  the  high  speed  point,  400  KI A S/0. 78  Mach, 
ielded  MMLE3  results  which  almost  exactly  matched  the  accepted 
alues.  The  accepted  values  were  extracted  from  the  results 
ub 1 i s he d  i  n  AF FTC-TR-6 1 -  1 5 ,  T-38A  Category  II  Stability  and 

ontrol  Tests.  Figure  A- 1 ,  in  Appendix  A,  is  a  copy  of  the  graph 
n  AFFTC-TR-6 1-15  which  summarizes  aircraft  short  period 
ha r a c t e r i s t i c s .  The  curves  in  Figure  A-l  are  faired  to  fit  both 
heory  and  the  original  flight  test  data.  The  original  data 
o  L  nt  s  are  near  0.48  Mach  and  0.78  Mach.  This  accounts  for  the 
lose  match  between  the  MMLE3  results  and  the  accepted  values  at 
hese  test  points.  The  MMLE3  results  for  the  mid-speed  point, 
00  KIAS/0.61  Mach,  don't  match  the  accepted  value  quite  as  well, 
s  can  be  seen  in  Figure  A-l,  the  accepted  value  is  an  estimate, 
used  on  the  curve  faired  to  fit  the  flight  test  data.  The  15% 
if  f erence  between  the  accepted  value  and  the  MMLE3  result  is 
mall  enough  to  be  attributed  to  the  way  the  curve  in  Figure  A-l 
s  faired.  However,  the  results  from  the  second  order  fit  of 
itch  rate  output  to  elevator  position  input  support  the  other 
IMLE3  results  for  this  point.  Overall,  it  is  apparent  that  the 
IMLE3  results  for  short  period  frequency  are  accurate,  based  on 


he  accepted  values. 

The  MMLE3  results  for  damping  ratio  don't  match  the  accepted 
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ACCEPTED  VALUES 


ESI 
OINT 


!48  K I A  S  /  n/a  Sweep  2.3  9  (0.08)  0.3  5  (0.06  )  2.36  0.30 

.48  Mach 


Elevator 

Doublet 

Low 

Frequency 

>00  KIAS/  Sinusoidal 
.61  Mach  Control 
Input 


2.68  (0.08)  0.36  (0.04) 


2.77  (0.07)  0.36  (0.05)  3.25  0.30 


n/a  Sweep  2.77  (0.06)  0.36  (0.04) 


>00  KIAS/ 

.78  Mach  n/a  Sweep  4.14  (0.09)  0.36  (0.04  )  H  ^  °‘$0 


Doub le  t  2 

300  KIAS/ 

. 6 1  Mach 
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Frequency 
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Values  extracted  f r om  AFFTC-TR- 6 1 -  1 5  ,  T-38A  Category  II  Stabili 
ty  and  Control  Tests 

-Values  determined  using  second  order  state-space  model  with 
elevator  position  input  and  pitch  rate  output. 

(*.**)  indicates  the  estimate's  Cramer-Rao  bounds 

Flight  Test  Results 


for  hands-off  flight  between  each  FTT.  In  addition  to  the  n/a 
sweep  and  elevator  doublet,  a  low  frequency  sinusoidal  control 
input  was  flown.  The  control  input  frequency  was  low  relative 
the  aircraft's  damped  frequency.  The  additional  data  gathered  at 
this  test  point  was  intended  for  use  as  a  comparison  to  the 
results  of  the  simulation  study,  as  reported  in  the  previous 


X  L  (  t  ) 
(  x2(t) 
x3  (  C  ) 


0  10  0 

-w2  -2C  u  K  ]  +  {  0  }  6  (t) 

g  00  q  ■*  p  '  ' 

0  0  LAG  LAG 


q(tA>  [  i/t02 


Xl(ti> 


0]  (  x2(t.)} 


x3(t.) 


(27) 


The  value  1/T02  was  experimentally  determined  to  be  1.00  using 
the  relationship  (ref  7). 

1/T02  ■(*,/•)(!/»„,,)  (28) 

The  value  LAG  was  allowed  to  vary. 

Allowing  the  value  LAG  to  vary  opens  up  different  data 
analysis  questions.  To  avoid  these  questions,  and  to  serve  as  a 
check  of  the  frequency  and  damping  ratio  results,  some  data  was 
also  processed  using  the  second  order  state-space  model  of 
equation  (21),  with  pitch  rate  as  the  output  and  elevator 
position  as  the  input. 

4.3  Test  Methods  and  Conditions 

Only  one  data  flight  was  flown.  Table  3  summarizes  the  test 
points  and  conditions. 

At  each  test  point,  the  aircraft  was  trimmed  at  test 
conditions  for  stable  hands  off  flight.  An  n/a  sweep,  as 
described  in  Chapter  3,  followed  by  an  elevator  doublet  were  then 
performed.  These  FTTs  were  used  to  generate  the  time  history 
data  for  MMLE3 . 

The  300  KIAS/0.61  Mach  test  point  was  the  primary  test  point 
for  this  flight.  At  this  test  point,  the  aircraft  was  trimmed 
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Chapter  4 


4.1  Flight  Test  Objectives 

A  limited  amount  of  flight  test  data  was  collected  to: 

1.  Determine  whether  or  not  the  current  USAF  TPS  in-flight 
instrumentation  system  is  adequate  for  use  with  MMLE3,  and 

2.  Assuming  that  the  instrumentation  is  adequate,  provide 
the  USAFTPS  a  flying  qualities  data  reduction  system  using  MMLE3. 
Both  of  these  objectives  could  be  met  by  successfully  using  MMLE3 
to  reduce  flight  test  data. 

The  primary  USAF  TPS  aircraft  are  the  NA-37,  T-38,  and  the 
RF-4C.  These  aircraft  are  simple  aircraft,  dynamically,  with 
longitudinal  dynamic  responses  which  are  adequately  described  by 
fourth  order  equations.  The  dynamic  responses  of  these  aircraft 
are  known,  and  can  be  compared  to  MMLE3  results  as  a  check  on 
reasonability.  The  T-38  was  used  for  this  test  because  the 
author  was  qualified  in  that  aircraft. 

4.2  Data  Reduction 

The  flight  test  was  intended  to  yield  aircraft  short  period 
frequency  and  damping  ratio  data.  The  aircraft  pitch  rate,  q, 
was  the  output,  and  the  longitudinal  elevator  control  position, 
,  was  the  input.  The  in-flight  instrumentation  system  samples 
these  parameters  at  8  samples  per  second.  The  data  was  not  pre- 
processed  to  filter  any  noise  or  to  remove  any  control 
hysteresis,  such  as  friction  and  breakout  forces.  Because  of 
this,  the  state-space  model  used  in  MMLE3  included  a  second  order 
short  period  response  augmented  with  a  first  period  lag.  The  lag 
was  used  to  account  for  any  control  surface  servo  dynamics  or 
hysteresis.  Equation  27  shows  the  model. 
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Since  only  simulated  data  was  used,  a  qualitative  analysis 
of  the  effect  of  sampling  rate  on  estimate  accuracy  was  made.  As 
expected,  with  higher  sampling  rates,  more  accurate  estimation 
can  be  expected  for  all  parameters. 

The  effect  of  noise  on  estimate  accuracy  was  also 
qualitatively  analyzed.  With  a  SNR  of  20  or  better,  reasonable 
estimates  (compared  to  no  noise  present)  could  be  obtained.  With 
higher  sampling  rates,  the  noise  had  slightly  less  effect, 
resulting  in  more  accurate  estimates. 

The  final  test  of  MMLE3  was  determining  lower  order 
equivalent  systems.  Simulated  data  was  generated,  incorporating 
a  lag  filter  into  the  simulation  model.  The  data  was  then 
processed  by  MMLE3  to  yield  a  lower  order  equivalent  system.  As 

expected:  oj  was  slightly  less  than  u>  ,  L  was  slightly  higher 

e  sp  e 

than  £  ,  and  the  estimated  time  delay,  x  ,  was  close  to  the 

s  p  e 

time  to  one-half  amplitude  for  the  lag  filter  used  in  the 


simulated  data. 


Lag  Filter 
Constant 

Tv, 

(  sec  ) 

8  SPS 
(sec) 

2  5  SPS 
(  sec  ) 

5.0 

0.139 

0.117 

0.106 

10.0 

0.069 

0.078 

0 . 068 

15.0 

0.046 

0.063 

0.050 

20.0 

0.035 

0.058 

0.039 

Equivalent  Time  Delay  Estimates 
Table  2 

As  can  be  seen  from  Figures  19  and  20  and  Table  2,  the 
actual  results  were  essentially  what  was  exp  ec  Led.  This  test 
completed  the  testing  of  MMLE3  with  simulated  dai_a,  and  verified 
that  MMLE3  can  be  used  to  determine  LOES  parameters  in  the  time 
domain. 

3.6  Summary  of  Chapter  3 

Based  on  the  results  of  testing  MMLE3  on  simulated  data,  it 
was  apparent  that  MMLE3  was  properly  installed  on  the  USAF  TPS 
computer.  Analysis  of  simulated  data  indicated  that  classical 
FTTs  should  be  good  techniques  of  exciting  the  aircraft  short 
period  response  for  parameter  identification. 

The  data  system  which  would  be  available  for  flight  test  was 
limited  to  8  samples  per  second.  For  that  reason,  simulated  data 
was  generated  at  8  samples  per  second  to  match  the  data  system. 
Results  for  parameter  estimation  at  a  data  rate  of  8  samples  per 
second  were  good,  resulting  in  estimates  of  frequency  and  damping 
ratio  within  2.5%  of  the  true  value. The  time  delay  estimate  was 
20%  high,  which  did  not  seem  unreasonable  when  compared  to  other 


LOES  determination  techniques  (ref  2). 
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Figure  19 
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The  data  was  propagated  using  the  same  propagation  scheme  as 

MMLE3,  as  explained  in  section  3.2  of  this  thesis.  This  data  was 

used  to  test  MMLE3  for  identification  of  the  defining  parameters 

of  an  LOES, T  ,  w  and  £ 

e  e  e 

It  was  expected  that  MMLE3  would  successfully  identify  LOES 
parameters,  with  the  following  differences  from  the  true 
characteristics  of  the  system  (ref  10).  With  a  small  lag  filter 

constant,  K,  the  equivalent  frequency,  to  ,  would  tend  to  be 

e 

smaller  than  the  actual  short  period  frequency.  As  K  increases 

in  value, should  approach  the  true  value  ui  ^  ,  but  stay  slightly 

low.  The  equivalent  damping  ratio,  ^ ,  with  a  small  value  of  K, 

should  be  large  relative  to  the  true  damping  ratio,  S  .  As  K 

increases,  L, ^  should  approach  £  g  ^  ,  but  stay  slightly  high.  the 

equivalent  time  delay  should  be  roughly  the  same  value  as  the  lag 

filter's  time  to  one-half  amplitude  Ti  .  With  higher  sampling 

rates,  u)g  and  £ ^  should  be  essentially  the  same,  but  with  smaller 

Cramer-Rao  bounds.  ,  the  equivalent  time  delay,  should  be 

smaller  with  a  higher  sampling  rate,  but  still  close  to  the  lag 

filter  t,  •  Figures  19  and  20  show  the  estimates  for  oo  and  C 
H  e 

for  8  SPS  and  25  SPS,  respectively.  Table  3  shows  the  equivalent 
time  de lays. 


As  can  be  seen,  a  signal-to-noise  ratio  of  approximately  20 
begins  to  yield  estimates  comparable  to  estimates  from  uncorrupt¬ 
ed  data.  The  effect  of  higher  sampling  rates  on  noise  corrupted 
data  is  essentially  the  same  as  the  effect  of  a  higher  sampling 
rate  on  uncorrupted  data. 

3.7  Identifying  an  Equivalent  Time  Delay 

The  model  used  in  the  simulation,  up  to  this  point,  has 
directly  linked  the  pilot's  control  input  to  the  aircraft 
response.  The  time  delay  in  the  simulation  has  been  a  pure  time 
delay,  rather  than  one  introduced  by  the  flight  control  system. 
A  more  accurate  simulation  model  would  introduce  a  lag  filter 
between  the  pilot's  control  input  and  the  aircraft  response  to 
model  delays  caused  by  the  flight  control  system  (ref  2,  9,  10). 
The  lag  filter  introduced  into  the  simulation  will  effectively 
change  the  apparent  short  period  frequency  and  damping  ratio,  as 


well  as  introducing  an  equivalent  time  delay,  t 


Figure  18 


shows  the  simplified  block  diagram  for  using  a  lag  filter  between 
pilot  control  input  and  pitch  rate  response. 


K  (s  +  1  /T, 
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Pitch  Rate  Response  Relation  to  Pilot  Input 
(Lag  Filter  Incorporated) 

Figure  18 

To  generate  data  with  a  lag  filter  incorporated 
simulation  model  was  modified  to  incorpr-  e  a  lag  filter. 


new  simulation  model  was: 
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It  is  important,  though,  that  the  aircraft  be  trimmed  for  hands- 
off  flight  immediately  prior  to  any  FTT,  and  that  some  of  the 
stable  point  be  recorded  along  with  the  FTT  time  history. 


Type  FTT:  n/ a  sweep 

FTT  Time  History  Length:  26.125  seconds 


Stable  Point 

w  ,  rad 

esn  sec  ^ 

L 

Time  History  Length 

s  e 

s  p 

2.250  Seconds 

2.77  (0.06) 

0.36  (0.04) 

0.125  Seconds 

2.77  (0.06) 

0.36  (0.04) 

(*.“*)  indicates  the  estimate's  Cramer-Rao  bounds 


Effect  of  Stable  Point  Time  History  Length 
on  MMLE3  Frequency  and  Damping  Ratio  Estimates 

Table  4 

The  secondary  restriction  on  the  data  is  on  the  length  of 
the  time  history.  If  an  elevator  doublet  time  history  records 
from  the  stable  point  through  the  entire  doublet,  approxiuately  5 
seconds,  then  the  results  will  match  the  results  shown  in  table  3 
for  the  elevator  doublet.  For  an  n/a  sweep,  though,  the  time 
history  length  is  more  critical.  The  longer  the  time  history, 
the  more  ccurate  the  estimates.  Table  5  shows  the  effect  of  the 


FTT  time  history  length  on  the  estimates. 


o v.*  v.v.  •-* 
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Type  FTT:  n/a  sweep 

Stable  Point  Time  History  Length:  2.25  seconds 


Time  History  Length 
26.125  Seconds 
12 . 000  Seconds 
6 . 000  Seconds 


0)  .  rad  , 

e  (  -  ) 

_ sp  sec 

2.77  (0.06) 

2.82  (0.0^) 

2.91  (0.11) 


e 

_  SP- _ 

0.36  (0.04) 
0.37  (0.07) 
0.40  (0.07) 


(*.**) indicates the estimate's Cramer-Rao bounds 

Effect  of  Time  History  Length 
on  MMLE3  Frequency  and  Damping  Ratio  Estimates 

Table  5 

Based  on  the  results  shown  in  table  5,  it  seems  reasonable 
that  a  minimum  of  a  15  second  time  history,  from  the  stable  point 
and  initiation  of  the  n/a  sweep,  would  be  necessary  to  yield  a 
good  estimate  of  frequency  and  damping  ratio. 

4.4  Summary  of  Chapter  4 

The  purpose  of  the  flight  test  was  to  determine  if  the 
current  USAFTPS  in-flight  instrumentation  system  could  provide 
data  of  high  enough  quality  for  reduction  by  MMLE3.  If  the  data 
was  good  enough,  the  flight  test  data  would  be  used  to 
demonstrate  a  flying  qualities  data  reduction  system.  The 
output  of  this  data  reduction  system  would  be  the  aircraft  short 
period  natural  frequency  and  damping  ratio. 

As  shown  by  the  results,  the  current  USAFTPS  in-flight 
instrumentation  system  is  adequate  to  provide  MMLE3  quality  data. 
The  single  test  flight  was  used  to  gather  T-38  short  period 
motion  data,  and  to  process  that  dat  through  MMLE3.  The  MMLE3 
results  for  T-38  short  period  frequency  and  damping  ratio  closely 
matched  the  accepted  values  for  T-38  short  period  frequency  and 
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damping  ratio.  The  data  processing  showed  two  restrictions  on 
what  type  of  dat4was  useable  for  MMLE3.  The  time  history  of  the 
FTT  must  be  immediately  preceded  by  a  stable  point,  where  the 
aircraft  is  trimmed  for  hands-off  flight.  This  stable  point  must 
be  included  in  the  data  time  history  for  MMLE3.  Additionally,  if 
the  maneuver  being  analyzed  is  an  n/a  sweep,  the  total  time 
history  (including  stable  point)  should  be  at  least  15  seconds  to 
ensure  good  results  from  MMLE3. 


Chapter  5 


5.1  Conclusions 

This  thesis  accomplished  all  objectives.  The  USAF  TPS 
currently  has  a  working  version  of  MMLE3,  a  general  maximum 
likelihood  parameter  estimation  program  installed  and  operating 
on  its  computer  system. 

Based  on  simulation  testing,  lower  order  equivalent  systems 
can  be  determined  from  time  domain  data  using  MMLE3.  With  high 
data  sampling  rates,  highly  accurate  estimates  can  be  obtained. 
With  low  data  sampling  rates,  marginally  acceptable  estimates  are 
obtained. 

Based  on  both  simulation  testing  and  flight  test  data,  MMLE3 
can  be  used  for  basic  flying  qualities  data  reduction.  Flight 
test  data  obtained  from  a  USAF  TPS  T-38  using  the  USAF  TPS  in¬ 
flight  instrumentation  system  showed  that  this  data  was  of 
sufficient  quality  to  yield  good  estimates  of  frequencies  and 
damping  ratios.  To  get  good  results,  the  maneuver  in  flight  has 
to  start  from  a  stable  point  so  that  MMLE3  has  good  initial 
conditions  to  work  from. 

5.2  Recommendation 

Based  on  the  results  of  testing,  MMLE3  can  be  used  to 
determine  LOES  parameters  using  time  history  data.  It  can  be 
also  be  used  to  determine  basic  flying  qualities  data.  The 
following  recommendations  are  made: 

1.  MMLE3  should  be  incorporated  into  the  USAFTPS  curriculum 
for  basic  flying  qualities  data  reduction. 

2.  MMLE3  should  be  incorporated  into  the  systems  phase  of 
the  curriculum  for  any  associated  LOES  testing. 
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The  log-decrement  method  of  data  reduction,  as  performed 
here,  is  explained  in  reference  9,  on  pages  7.59  through  7.64. 
The  strip  chart  record  is  the  basis  for  this  data  reduction 
method.  The  free  response,  after  an  elevator  doublet,  is  used  to 
determine  short  period  frequency  and  damping  ratio. 

The  control  input  used  to  define  the  end  of  the  forced 
response  and  the  beginning  of  the  free  response,  was  longitudinal 
control  position,  as  marked  on  the  strip  chart  in  figure  A-2. 
Pitch  rate  response  was  used  as  the  aircraft  free  response. 

Three  free  response  "peaks"  can  be  seen.  These  peaks  are 
the  magnitude  of  the  overshoot  from  the  steady  state  condition. 
Using  a  computer  printout  of  the  response,  it  is  easier  to 
determine  the  values  of  these  peaks,  although  not  necessarily 
more  accurate.  The  peaks  were: 


xo 

-3.4102 

-0.2857 

X1 

-0.9751 

Vxi 

=  0 .6662 

X2 

*0 .6496 

V'o 

=0 .1905 

The 

time  between  the 

peaks  were 

1.229 

seconds 

and  1.293 

seconds. 

Treating  that  as 

the  damped 

short 

period, 

the  damped 

short  period  frequency  is  2.49  rad/sec. 

Using  the  subsidence  ratios  and  using  the  chart  in  reference 
9  on  page  7.62,  the  damping  ratio  is  approximately  .240. 


These  results  are  from  fitting  only  three  points  to  a  second 
order  response  model,  as  defined  by  the  charts  used.  This  data 
reduction  technique  is  very  subjective,  and  prone  to  interpretive 


As  stated  in  section  2 ,  HMLE3  only  needs  an  adequate  state- 
space  model  and  a  time  history  relating  input  to  output  to 
generate  good  estimates.  At  the  beginning  of  the  time  history 
data  file,  the  state-space  model  is  defined  by  the  user.  For 
this  appendix,  the  input  for  the  time  delay  state-space  model 
(equation  25)  will  be  shown  and  explained.  The  beginning  of  the 
data  file  is: 

NO  USE  OF  STANDARD  AIRCRAFT  ROUTINES 
000000125  000010000 
AN  3  3 

-19.60  -4.214  -9.772 

-16.0 

BN  3  1 

0.0 
4.886 
16.0 
AV 


0. 

0. 

0. 

1 . 

1  . 

1  . 

0. 

0. 

1  . 

CN  1 

3 

1  .372 

1  . 

0. 

GGI  1  1 

40000. 

HARD 

BN ( 02 ,01 )*AN (02, 02)*-. 5 
BN (03, 01 )»AN( 0  3,03  )*-l  . 

END 

The  first  lie  indicates  to  MMLE3  that  no  aircraft  stability 
derivatives  are  being  determined.  Rather  than  using  a 
predetermined  state-space  model,  the  state-space  model  defined  by 
the  input  matrices  will  be  used.  The  next  line  defines  the  start 
and  stop  times  for  the  data  to  be  processed.  The  time  history 
data  for  an  entire  flight  can  be  in  one  data  file,  but  the 
different  test  points  of  that  flight  can  be  analyzed  separately 
by  MMLE3  if  the  start  and  stop  times  for  the  different  FTTs  are 


known. 


These  times  are  in  hours,  minutes. 


seconds,  and 


ilLiseconds.  The  Fortran  format  for  this  date  line  is 
2(312 , 13, IX)  )  . 

The  'N'  suffixed  matrices  define  the  state-space  model.  The 
tate-space  model  which  MMLE3  uses  is 

x (  t  )  =Ajc(  t  )  +  Bu(  t ) 

2  (  t.  )  =Cx(  t.  )  (29) 
he  'N'  suffixed  matrices  define  the  matrices  define  the  matrices 
f  the  above  equations;  and  give  the  initial  estimate  of  what  the 
nswer  should  be. 

The  '  V'  suffixed  matrix  define  exactly  which  elements  of  the 
atrix  are  allowed  to  vary.  If  the  value  1.  appears  in  the  AV 
atrix,  then  the  corresponding  value  in  the  AN  matrix  can  be 
hangedby  MMLE3.  The  'V*  suffixed  matrices  define  thevector 

The  inverse  noise  covariance  matrix  GGI  is  identical  to  the 
iatrix  R  used  in  Section  2.2  of  the  thesis.  It  is  not 
articularly  for  determination  of  lower  order  equivalent  system 
arameters.  The  GGI  (R)  matrix  acts  as  a  weighting  matrix  for 
he  different  output  states  being  estimated.  Since  only  one 
utput  state,  pitch  rate,  is  used  in  this  model,  GGI  becomes 
nimportant.  Varying  GGI  will  not  vary  the  maximum  likelihood 
stimates  or  the  Cramer-Rao  bounds. 

The  'HARD'  line  following  the  GGI  input  defines  restraints 
n  the  solution.  For  the  time  delay  model,  both  the  transfer 
unction  gain  and  the  time  delay  appear  in  both  the  AN  matrix  and 
he  BN  matrix.  This  constraint  forces  MMLE3  to  treat  these 
alues  properly  when  varying  the  value  in  one  of  the  matrices. 

The  line  containing  'END'  signals  the  end  of  user  input 
mtrices  and  the  beginning  of  the  time  history  data. 


Only  the  matrices  which  are  necessary  to  the  state-space 
del  need  to  be  input.  This  adaptation  of  MMLE3  can  accept  up 


5  state  model  for  either  input  or  output. 

For  the  purposes  of  USAF  TPS  use  of  MMLE3,  the  time  history 
ta  files  are  generated  automatically.  However,  if  a  user  wants 
use  MMLE3  in  a  different  manner,  then  a  different  state-space 
del  will  have  to  be  set  up.  For  more  information  on  MMLE3,  and 
tting  up  data  files,  see  reference  3. 
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